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band. 



BNSDOCID: <WO 0057634A1 J_> 



FOR THE PURPOSES OF INFORMATION ONLY 
Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senegal 


AU 


Australia 


GA 


Gabon 


LV 


Latvia 


SZ 


Swaziland 


AZ 


Azerbaijan 


GB 


. United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


UZ 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


ZW 


Zimbabwe 


CI 


Cdte d'lvoire 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


PT 


Portugal 






cu 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






cz 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


LI 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







BNSDOC1D: <W0 0057634A1_I_> 



WO 00/57634 



PCT/US00/07381 



PIXEL READ-OUT ARCHITECTURE 

BACKGROUND 

1. Field of th e Invention : 

The present invention relates to digital photography. In particular, the described 
embodiments relate to digital imaging arrays. 

2. Related Art : 

Digital cameras have enabled the convenient transfer of still images to computer 
readable memory. A digital camera typically includes a lens which focuses light reflected from 
objects onto an electronic imaging array. An image exposure is then captured onto a computer 
readable memory, allowing for the convenient reproduction of the image by a color printer which 
may be part of a personal computer system. 

The imaging array typically includes a plurality of pixels or light sensitive elements. By 
use of appropriate filters, the pixels are made sensitive to energy in particular color bands or 
spectral regions. For example, a typical imaging array has three sets of pixels, each pixel being 
sensitive to one of red light, blue light and green light. Such an array is described in detail in 
U.S. Patent No. 3,971,065 to Bayer. These imaging arrays typically form a mosaic pattern which 
uniformly distributes each of the three sets of pixels over the array. The individual pixels in the 
array sense the intensity of light in specific spectral regions at specific locations in the imaging 
array. This enables the reconstruction of the image using techniques known to those of ordinary 
skill in the art. 

Conventional imaging arrays comprise charge coupled devices (CCDs) to convert a pixel 
of light energy into charge. The charge is stored in a capacitor formed in the imaging array at 
the pixel location. The quantity of stored charge is proportional to the energy received at the 
pixel location over an exposure period. Additionally, imaging arrays have been constructed from 
active pixel sensor (APS) cells to convert light energy into an electric voltage at a photodiode. 
Circuitry for implementing APS cells is shown in U.S. Patent Nos. 5,471,515 and 5,587,596. 
The APS cell imaging arrays can be integrated into a CMOS imaging chip, i.e., integrated circuit. 

The circuitry for all of the pixels in an imaging array is typically uniform regardless of 
the color of the individual pixels. CCD and APS imaging arrays typically cannot identify the 
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wavelength or color of light detected at a particular pixel based solely upon the electrical signal 
generated at the output of the pixel. Color selectivity is provided by controlling the color of light 
that is allowed to reach a photo detector. One typical method includes directly depositing 
transmission filters onto substrate areas where individual pixels are located. The filter color 
5 pattern deposited on a given pixel element in the imaging array controls the color of light that is 
detected by that particular pixel. Thus, while the optics produce an image which has the same 
color depth at each point of the image, the image incident on the imager collects only one color 
at each pixel location. If red, green and blue are used as the primary colors, a typical imaging 
array will have individual pixels with a red, green or blue filter deposited thereon. A typical 

10 system is described in detail in the aforementioned U.S. Patent No. 3,971,065. 

Digital cameras employ several methods for extracting the pixel data from the imaging 
array. For a CCD based array, the charge stored at the pixel locations in the array may be 
sequentially transferred to the capacitors of neighboring pixels, one pixel at a time, until the 
charge reaches a read-out circuit for quantizing the charge at an edge of the array. For example, 

15 in some systems, the charges stored at each pixel location may be simultaneously shifted in a 
direction toward the read-out circuitry. 

For an APS based array, the voltages at the photodiodes may be coupled directly to the 
read-out circuit. The voltages for the individual pixels are typically readout one row at a time by 
applying a row selection signal to a row of pixels, while the read-out circuit receives the 

20 corresponding voltages from each pixel in the row. 

Existing read-out circuitry generates mixed color data. Readout techniques for 
extracting data from an imaging array having a Bayer pattern typically provide mixed color data 
in which blue pixel data is interleaved with green pixel data, and red pixel data is interleaved 
with green pixel data. The mixed color data is typically stored in a memory to be processed later 

25 - in a digital image processor. Certain image processing techniques require color processing „. 

which utilizes algorithms applied to all pixels of a particular color. This requires sorting of the 
mixed color data stored in the memory. This increases processing requirements at the image 
processor which contributes to increased cost, power consumption and weight of a digital 
camera. Therefore, there is a need for facilitating color extraction which reduces the 
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requirements for processing at a digital image processor. 
SUMMARY 

An object of an embodiment of the present invention is to provide an architecture for the 
efficient extraction of data from photo sensors. 
5 Another object of an embodiment of the present invention is to provide a system and 

method for extracting data from photo sensors which reduces processor and memory 
requirements for digital cameras. 

ft is another object of an embodiment of the present invention to provide a system and 
method for simplifying color processing in digital cameras. 
10 It is another object of an embodiment of the present invention to reduce the cost, weight 

and power consumption of digital cameras. 

It is yet another object of an embodiment of the present invention to provide a system 
and method for grouping information extracted from pixels on an imaging array by color. 

Briefly, an embodiment of the present invention is directed to a system for extracting 
15 data from an array of light-sensitive elements. Each of the light-sensitive elements is sensitive to 
energy in one of a plurality of spectral regions. An extraction circuit extracts data representative 
of the intensity of photo-exposure of each of a plurality of the light-sensitive elements in 
extraction intervals. The data extracted in each extraction interval at the extraction circuit 
originates from light-sensitive elements associated with a common spectral region (e.g., red). 
20 Accordingly, all signals extracted at the extraction circuit in any particular extraction 

interval are representative of photo-exposures of the light-sensitive elements which are sensitive 
to energy in the same common spectral region. This enables uniform color processing on data 
read out from the extraction circuit following an extraction interval. This reduces the 
requirements for digital processing which in turn reduces manufacturing costs, weight and power 
25 consumption of a digital camera. 

BRIEF DESCRIPTION OF THE FIGURES 

Figure 1 shows an imaging array with related read-out circuitry according to an 
embodiment of the present invention. 

Figure 2 shows an embodiment of the imaging array of Figure 1 in which all light- 
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sensitive elements in each column have a common column sense line, and all light-sensitive 
elements in each row have a common row select line and a common reset line. 

Figure 3 shows an embodiment of the circuitry which may be formed in the substrate in 
the location of a light-sensitive element of the imaging array of Figure I. 

Figures 4a and 4b show plots of the absorption characteristics in pixel regions of the 
imaging array of Figure 1 according to an embodiment. 

Figures 5a and 5b show a first embodiment of the scanning readout circuits in the 
embodiment of Figure 1. 

Figure 6 shows a schematic diagram illustrating an embodiment of downstream 
processing of the output signals of the scanning readout circuits shown in Figures 5a and 5b. 

Figure 7 illustrates a second embodiment of a scanning readout circuit in the 
embodiment of Figure 1 . 

Figure 8 shows a schematic diagram illustrating an embodiment of downstream 
processing of the output signals of the scanning readout circuit shown in Figure 7. 

Figure 9 shows an embodiment of the present invention in which the imaging array 
includes light-sensitive elements which are sensitive the light in four spectral regions. 
DETAILED DESCRIPTION 

Embodiments of the present invention are directed to a system and method for extracting 
color information from a photo energized imaging array having multicolored pixels. A read-out 
architecture allows for the collection of image data for each color separately. Sub-images for 
each color may then be constructed without an intermediate step of sorting mixed color data 
stored in a memory. These subimages may then be processed by pipelined signal processing 
circuitry to reduce the processing requirements of central processing hardware of a digital 
camera. 

Figure 1 illustrates an embodiment of the present invention which includes an imaging 
array 10 and scanning readout circuits 12 and 14 for extracting data which is representative of 
the intensity of photo exposure of individual pixels in the array 10 over an exposure period. The 
imaging array 10 is an m by n array of light sensitive elements or pixels which are sensitive to 
energy in a spectral region. The embodiment of Figure 1 includes pixels which are sensitive to 

_0057634A1_I_> 



WO 00/57634 PCT/US00/07381 

5 

energy in spectral regions for red, green and blue light as indicated by the letters R, G and B, 
respectively. According to an embodiment, the array 10 has 1.024 columns and 768 rows, 
complying with the XGA standard of 1,024 columns by 768 rows. The array 10 may include 
additional rows and columns of pixels to minimize edge effects. However, embodiments of the 
5 present invention are not limited to any specific size or dimension of array. Figure 1 illustrates 
an embodiment in which the arrangement of color pixels are in a Bayer pattern as disclosed in 
U.S. Patent No. 3,971,065. However, embodiments of the present invention are also applicable 
to other color patterns in an imaging array. 

According to an embodiment, the imaging array 10 is exposed to light emitting from an 

10 object for a brief period of time. In an embodiment in which the array 10 is installed in a digital 
camera, this may take the form of opening and closing a physical shutter to allow focused light 
passing through a lens to impinge upon the individual pixels of the array 10 for an exposure 
period such as 30 to 35 msec. Following exposure, signals representative of the energy collected 
from the exposure of the individual pixels in the array are read out from the imaging array 10, 

15 one row at a time. These signals are readout from a particular row by applying a voltage to a 

row select line 16 corresponding with the row. As shown in Figure !, each of the rows 1 through 
n have an associated row select line 16, - 16 n . Upon selection of a row select line 16 for a 
particular row, the scanning circuits 12 and 14 extract signals representative of the intensity of 
photo exposure of each of the pixels in the row at column sense lines 20. As shown in Figure 1, 

20 there are an m number of column sense lines 20, one for each column. 

Scanning readout circuits 12 and 14 have associated switches 25 and 23 coupled to the 
column sense lines 20. The scanning readout circuits 12 and 14 sample intensity values from 
each row in the array 10 at extraction intervals one row at a time. According to an embodiment, 
the switches 25 and 23 alternate from coupling to the column sense lines 20 of adjacent columns. 

25 In this manner, in each extraction interval, all of the intensity values extracted at a particular 

scanning readout circuit 12 or 14 originate from pixels of the same color or spectral region. At 
any extraction interval, each of the switches 25 and 23 are coupled to either an even or odd 
column sense line 20. If the switches 25 are coupled to the odd column sense lines 20 in an 
extraction interval, for example, the switches 23 are coupled to the even column sense lines 20. 
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Likewise, if the switches 25 are coupled to the column sense lines 20 of odd columns, the 
switches 23 are coupled to the column sense lines 20 of even columns. 

As an example, consider the extraction of intensity values at rows 1 through 4 in 
successive extraction intervals. In the first extraction interval, row select line 16, is enabled so 
5 that signals representative of the intensity of the photo exposure of the pixels in row 1 are 
provided to the column sense lines 20. The switches 25 are positioned to couple to the odd 
column sense lines (i.e., column sense lines 20„ 20 3 , ...) to circuit 14, and the switches 23 are 
positioned to couple the even column sense lines (i.e., column sense lines 2ft, 20 4 , ...) to 
circuit 12. Here, the scanning circuit 14 collects the intensity values of all of the green pixels, 
10 and the scanning circuit 12 collects all of the red pixels in row 1 . In a subsequent extraction 

cycle, row select line 16, is enabled and the switches 25 couple the scanning readout circuit 14 to 
the column sense lines 20 of the even columns, and the switches 23 couple the scanning readout 
circuit 12 to the column sense lines 20 of the odd columns. Here, the intensity values for all 
green pixels in row 2 are extracted at the scanning circuit 14, and the intensity values for all blue 
1 5 pixels in row 2 are extracted at the scanning circuit 1 2. For the extraction cycle at row 3, row 
select line 16 3 is enabled and the switches 25 couple the scanning readout circuit 14 to the 
column sense lines 20 of odd columns, and the switches 23 couple the scanning readout 
circuit 12 to the column sense lines 20 of even columns. The scanning circuit 14 extracts the 
intensity values of all of the green pixels in row 3. Similarly, the scanning circuit 12 extracts the 
20 intensity values of all of the red pixels in row 3. For the fourth row, row select line 16, is 

enabled and the switches 25 couple the scanning readout circuit 14 to the column sense lines 20 
of the even columns, and the switches 23 couple the scanning readout circuit 12 to the column 
sense lines 20 of the odd columns. Here, the scanning circuit 14 extracts the intensity values for 
each of the green pixels in row 4 and the scanning circuit 12 extracts the intensity values for all 
25 of the blue pixels in row 4. 

This switching sequence is repeated until the intensity of photo exposure of each of the n 
rows is extracted at either the scanning circuit 12 or the scanning circuit 14. By alternating the 
positions of switches 23 and 25 in a complementary, alternating fashion as discussed above, in 
any particular scanning interval all of the intensity values extracted at a particular scanning 
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circuit 12 or 14 are of the same color or spectral region. For a Bayer-patterned array, the 
scanning circuit 14 extracts intensity values for each of the green pixels in a row during each 
extraction cycle. For the illustrated array, the scanning circuit 12 extracts intensity values for all 
of either the red or blue pixels in a selected row during each extraction cycle. During any 
5 particular extraction cycle, the scanning circuit 12 extracts intensity values corresponding to only 
one of the red and blue colors. During the extraction of rows 1 and 3 as discussed above, the 
scanning circuit 12 extracts the intensity values for only red pixels during those extraction 
intervals. Similarly, during the extraction of rows 2 and 4, the scanning circuit 12 extracts only 
intensity values corresponding to blue pixels. This sequence continues throughout the extraction 

10 of the intensity values from the rows 1 through n. At every extraction interval, the scanning 
circuit 14 will extract intensity values only from green pixels. The scanning circuit 12 only 
extracts intensity values only of either red pixels or blue pixels, depending upon whether the 
extracted row is odd or even. Thus, the architecture of the present embodiment permits the 
separation of color data upon extraction at the scanning circuits 12 and 14. 

15 Figure 2 illustrates an embodiment of the imaging array 10 in which each of the 

column sense lines 20 is coupled continuously through each pixel in its respective column. 
Similarly, Figure 2 shows that each of the row select lines is coupled to each of the pixels in the 
respective row. Figures 1 and 2 also show reset lines 18, through 18 n , each corresponding to an 
associated row in the imaging array 10. The reset lines 18 are enabled following extraction 

20 intervals to reset the pixel elements as described with reference to Figure 3. 

Figure 3 illustrates exemplary circuitry for an individual light-sensitive element in the 
embodiment shown in Figures 1 and 2. In particular, Figure 3 shows circuitry for a pixel in a 
CMOS active pixel sensor (APS) array according to an embodiment of the imaging array 10. A 
photodiode 30 (having a parasitic capacitance) and capacitor 3 1 accumulate photon generated 

25 charge during the exposure period. Prior to exposure, the reset line 1 8 is enabled to momentarily 
close a transistor switch 34. When the transistor switch 34 is closed, the photodiode 30 is 
reverse biased at an initial voltage. During the exposure period, electrons accumulate at the 
photodiode 30 and capacitor 3 1 in proportion to photon flux incident on the photodiode, raising 
the potential above the reset voltage. This voltage is applied to the gate of a sense transistor 32. 
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Thus, when the row select line 1 6 is enabled, closing the transistor switch 36, the transistor 32 
provides an amplified signal to the column sense line 20 which is representative of the photon 
flux collected at the photodiode 30 and capacitor 3 1 during the exposure period. Similar circuits 
are described in the aforementioned U.S. Patent Nos. 5,471,515 and 5,587,596. 
5 Figure 3 shows that the photodiode 30 and the capacitor 3 1 as distinct components. 

Thus, photon charge is accumulated at the parasitic capacitance of the photodiode 30 and the 
capacitance of the capacitor 3 1 . In other embodiments, the photon charge may be accumulated 
only at the parasitic capacitance of the photodiode 30, eliminating the requirement for forming 
an additional capacitor in parallel with the photodiode 30. 
10 Figures 4a and 4b show plots of the absorption characteristics of the blue, red, and green 

pixels in the imaging array 10 according to an embodiment with selected red, blue and green 
transmissive filters deposited over the photodiodes 30 illustrated in Figure 3. Each pixel has an 
associated photodiode basic CMOS characteristic response to unfiltered light. In preferred 
embodiments, the imaging array 10 is disposed within a camera (not shown) having a lens (not 
15 shown) for focusing light onto the imaging array 10. As illustrated in Figure 4a, the lens acts to 
low-pass filter the impinging light, limiting the pixel responses to only photon energy in the low- 
pass spectral region. 

Figure 4b shows a detailed plot of the absorption characteristics at pixel locations having 
red, green and blue transmissive filters. As discussed above with reference to Figure 3, a 

20 photodiode at each pixel outputs a voltage representative of the photon energy collected at the 
photodiode over an exposure period. This voltage is preferably representative of an integration 
of the photon energy (attenuated according to the characteristics in the associated profile of 
Figure 4b) collected over the exposure period. Figure 4b illustrates that the green pixels are the 
most responsive to photon energy in the visible spectrum (i.e., photon energy having 

25 wavelengths between 400 and 700 nm). As discussed .below, the outputs of the pixels are 

preferably adjusted to normalize output voltages to account for the different levels of response 

from different colored pixels. 

Figures 5b and 5a show an embodiment of the scanning readout circuits 12 and 14 of the 
embodiment shown in Figure 1 . Switches 23 and 25 receive each of the column sense lines 20, 
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through 20 m . Referring to Figure 2, each scanning interval, a voltage is applied to a selected one 
of the row select lines 1 6 at a corresponding row. This applies the voltages at each of the 
photodiodes 30 in the selected row to a corresponding column sense line 20. 

Returning to Figures 5a and 5b, each of the column sense lines 20, through 20 m are 
received at a corresponding switch transistor 70 at the switches 25, and at a switch transistor 72 
at the switches 23. The switch transistors 70 and 72 are switched on or off by the signal <}) A and 
its complement signal $ A . As discussed above with reference to Figure 1, during any particular 
scanning interval, the scanning readout circuits 12 and 14 each extract voltage information from 
photodiodes in the same row in the imaging array 10. 

While the scanning readout circuit 12 is receiving image data from odd column sense 
lines 20 (i.e., column sense lines 20,, 20 3 , etc.), the scanning readout circuit 14 is receiving 
image data from the even column sense lines 20 (i.e., column lines 20>, 20 4 , etc.). In such an 
interval, when the scanning readout circuit 12 is to read values from the odd column sense 
lines 20 and the scanning readout circuit 14 is to read values from the even column sense 
lines 20, the value of $ A is high to turn on the switch transistors 7(X, 70 4? etc. (corresponding to 
the even column sense lines 20) and to turn on the switch transistors 72,, 72 3 , etc. (corresponding 
to the odd column sense lines 20). Meanwhile, the value of <|> A is low to turn off the switch 
transistors 70,, 70 3 , etc. (to decouple the odd column sense lines 20 from the scanning readout 
circuit 14) and to turn off the switch transistors 72,, 72 4 , etc. (to decouple the even column sense 
lines 20 from the scanning readout circuit 1 2). 

In a subsequent scanning interval, <{> A is high and $ A is low. This enables select switch 
transistors 70,, 70 3 , etc. to couple the odd column sense lines 20 to the scanning readout 
circuit 14 and enables transistors 722, 72 4 , etc. to couple the even column sense lines 20 to the 
scanning readout circuit 12. Since $ A is low, the switch transistors 70,, 70 4 , etc. corresponding 
to the even column sense lines 20 are turned off (to decouple the even column sense lines 20 
from the scanning readout circuit 14), and the switch transistors 72,, 72 3 , etc. corresponding to 
the odd column sense lines are turned off (to decouple the odd column sense lines 20 from the 
scanning readout circuit 12). 

A transistor 66 and corresponding capacitor 62 form a sample and hold circuit in the 
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scanning readout circuit 14. Similarly, each transistor 68 and corresponding capacitor 64 form a 
sample and hold circuit at the scanning readout circuit 12. At each scanning interval, the signal 
<J) B is enabled for an appropriate sampling interval to turn on transistors 66, through 66 m/2 and 
turn on the transistors 68, through 68 m/2 . This causes a sampling of the voltage at the 
5 corresponding photodiode 30 (Figure 3) for storage at either a corresponding capacitor 62 at the 
scanning readout circuit 14 or corresponding capacitor 64 at the scanning readout circuit 12, 
depending on where the photodiode is located within the selected row. 

Scanning readout circuits 12 and 14 include shift registers 50 and 52. Shift registers 50 
and 52 preferably have a length of m/2 and an output at each location. The shift registers 50 and 
10 52 are preferably loaded with a single "1" at one location, and loaded with "0s" at the remaining 
locations. During each scanning interval following the assertion of the (fe signal to sample the 
voltage at the photodiodes, the single "1" in the shift register 50 is shifted sequentially to all 
locations and provided as an output to the gate of a corresponding transistor 54, applying a high 
signal to the gate to turn on transistor 54. When a switch transistor 54 is turned on, the voltage 
1 5 stored at the corresponding capacitor 62 is coupled to the output line 22 through a buffer 

amplifier 58. The buffer amplifier 58 preferably provides sufficient output impedance to the 
output bus 22 to quickly drive the output bus through downstream processing described below 
with reference to Figure 6. A similar function is performed in the scanning readout circuit 12 in 
which a single "P in the shift register 52 is sequentially shifted through the length of the shift 
20 register 52 once following the assertion of the 4% signal to apply the voltages stored at the 
capacitors 64 to the output bus 24. 

Figure 6 is a block diagram illustrating an embodiment which is used to process signals 
from the output bus 22 of the scanning readout circuit 14, and signals from the output bus 24 of 
the scanning readout circuit 12. These signals are processed to provide binary values which are 
25 representative of the photon energy collected by the photodiodes 30 during exposure. When the 
voltage at a capacitor 62 in the scanning readout circuit 14 is coupled to the output bus 22 
through a corresponding switch transistor 54, a variable gain amplifier 82 applies a gain to the 
signal which is then digitized at an analog-to-digital converter 84. As discussed above, in 
preferred embodiments, all of the output values applied to the output bus 22 during any 
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particular scanning interval are all representative of an intensity of photo exposure on pixels of 
the same color. For example, referring to the discussion above with reference to Figure I, the 
output values on the output bus 24 may be all red pixel output values or all blue pixel output 
values during alternating scanning intervals (or, green pixel output values during every scanning 
5 interval). 

When the scanning readout circuit 12 is outputting all red pixel values on odd scanning 
intervals and all blue pixel values on the remaining even scanning intervals, a selection circuit 90 
can load the contents of an odd row gain register . 92 to the variable gain amplifier 86 to program 
the variable gain amplifier 86 to apply an appropriate gain uniformly to all output values of red 
10 pixels. For the even rows, the selection circuit 90 may then load contents of an even row gain 
register 94 to the variable gain amplifier 86 to uniformly apply a gain to output values of blue 
pixels. Thus, the selection circuit 90 will control the variable gain amplifier 86 to provide two 
different gains at alternating intervals, each gain to be applied to intensity values of a 
corresponding color. 

15 This feature can be useful in, for example, normalizing the intensity of output values of 

different colored pixels which may be biased due to the non-uniform physical sensor response 
characteristics as shown in Figure 4b. For example. Figure 4b shows that the sensor response at 
red pixels is not as high as the sensor response at the blue or green pixels. Thus, for output 
values from red pixels, the variable gain amplifier 86 may provide a higher gain than to the 

20 output values from the blue pixels in the alternating scanning intervals. An even smaller gain 

may be applied by a variable gain amplifier 82 to the output values on output bus 24 from green 
pixels. 

In the embodiment in which the scanning readout circuit 14 only outputs intensity values 
from green pixels, the value stored in the odd row gain registered 76 and even row gain 
25 register 78 are the same so that the selection circuit 80 will program the variable gain 

amplifier 82 to apply uniform gain to all of the green pixel values outputted at the output bus 24. 
The digitized values outputted from the analog digital converters 84 and 88 may then be used to 
create sub-images having either all red, all blue or all green pixel values which are uniformly 
normalized by the variable gain amplifiers 82 and 86. 
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Figures 7 and 8 illustrate an embodiment of the scanning readout circuit 14 and 
accompanying downstream processing in which output values are provided to two different 
output buses 22, and 22 2 . This embodiment also preferably includes similar circuitry for the 
scanning readout circuit 12 and its accompanying downstream processing (not shown). It will be 
5 understood by those of ordinary skill in the art that the principles of Figures 7 and 8 readily 
apply to the scanning readout circuit 12 and its accompanying downstream processing. 

Here, a single "1" is sequentially shifted through a shift register 150 following an 
assertion of the 4> B signal to switch on switch transistors 1 54, applying voltage values stored in 
the capacitors 162 to the output bus lines 22, and 22,. At each position in the shift register 150, 
10 the single "1" applies a high signal to the gates of two different switch transistors 1 54. This will 
simultaneously apply output voltages to each of the output bus lines 22, and 22,. By reading out 
pixel values at two different output bus lines 22, and 22 2 , the voltages at the individual 
photodiodes 30 in the imaging array 10 can be read out faster. This may be advantageous in 
situations where there is significant leakage at the photodiodes 30, causing an offset in the 
1 5 voltages sampled at each of the photodiodes 30 based upon whether the voltage at the 
photodiode 30 is sampled at an earlier or later scanning interval. 

Figure 8 illustrates the processing of the voltages provided at the output lines 22, and 22, 
in the embodiment of Figure 7. Selection circuit 1 80 preferably loads the same value from either 
odd row gain register 176 or even row gain register 178 to each of the variable gain 
20 amplifiers 182, and 182,. Corresponding analog-to-digital converters 184, and 184 2 process the 
outputs of variable gain amplifiers 182, and 182, to provide digital representations of pixel 
intensity values. The selection circuit 180 alternates loading the contents of the odd row gain 
register 176 and the even row gain register 178 into the variable gain amplifiers 182 and 182, to 
apply uniform gains to voltages representative of the intensity of photo exposure on pixels of the 
25 same color, as discussed above with reference to Figure 6. 

Figure 9 shows an embodiment in which the scanning readout circuits 14 and 12 are 
coupled to an imaging array 1 10 which includes pixels of four different colors: green, red, blue 
and white (labeled with the letters G, R, B and W), which are formed on a semiconductor 
substrate. As in the imaging array 10 shown in Figures 1 through 3, the red, green and blue 
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pixels of the imaging array ! 10 are formed by depositing transmissive filters on the 
semiconductor substrate over the photodiode regions. The white pixels are formed by having an 
absence of any transmissive filter deposited over the semiconductor substrate over the 
corresponding photodiode region. This is described in detail in U.S. patent application serial No. 
5 09/274,413, filed on March 22, 1999, for "Color Filter Pattern for Imaging Array'\ assigned to 
Biomorphic VLSI, Inc., the disclosure of which is incorporated by reference herein. 

In a manner similar to that discussed above with reference to Figures 1-3, at the scanning 
intervals, each of the scanning circuits 12 and 14 will extract values representative of the 
intensity of photo exposure over pixels of all the same color. For example, in the example 

10 discussed above, the scanning readout circuit 12 extracts intensity values of either red pixels or 
blue pixels, depending upon whether the extracted row is odd or even. Rather than extracting 
intensity values from only green pixels at the scanning readout circuit 14 as in the previous 
example, in the embodiment of Figure 9, the scanning readout circuit 14 reads out intensity 
values of green pixels or white pixels, depending upon which row in the imaging array 1 10 is 

15 being selected. The variable gain amplifiers 82 and 86 (Figure 6) in the down stream processing 
may then apply a uniform set gain to each intensity value of the same color pixels. 

For intensity values extracted at the extraction readout circuit 14 during an extraction 
interval for an odd row, all originating at green pixels, the variable gain amplifier 82 applies a 
gain based upon the contents of the odd row gain register 76. For intensity values extracted at 

20 the scanning readout circuit 14 during an extraction interval for an even row, all originating at 
white pixels, the variable gain amplifier 82 applies a gain based upon the contents of the even 
row gain register. Since the sensor response for the unfiltered white pixels is significantly 
greater than the sensor response for the green pixels (Figure 4b), the gain uniformly applied to 
the intensity values originating at the white pixels during the even row extraction intervals is 

25 preferably lower than the gains uniformly applied to the intensity values originating at the green 
pixels during the odd row extraction intervals. 

The embodiments discussed above provide a pixel readout architecture which allows 
downstream processing to apply a uniform set gain to all of the extracted intensity values to 
pixels of the same color. This permits the construction of sub-images comprising color 
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information which is pre-processed, reducing the processing requirements of downstream image 
processing hardware in a digital camera. 

While the description above refers to particular embodiments of the present invention, it 
will be understood that many modifications may be made without departing from the spirit 
thereof. The accompanying claims are intended to cover such modifications as would fall within 
the true scope and spirit of the present invention. 

The presently disclosed embodiments are therefore to be considered in all respects as 
illustrative and not restrictive, the scope of the invention being indicated by the appended claims, 
rather than the foregoing description, and all changes which come within the meaning and range 
of equivalency of the claims are therefore intended to be embraced therein. 
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CLAIMS 

1 . A method of extracting data representative of photo-exposure intensity from light- 
sensitive elements in an array of light-sensitive elements, the array having distinct first and 
second sets of rows of the light-sensitive elements, each of the light-sensitive elements having a 

5 sensitivity to energy in one of a plurality of spectral regions and being associated with a 

corresponding spectral region, each row having light-sensitive elements which are associated 
with at least two spectral regions, the method comprising: 
at a first scanning circuit, 

from each row in the first set of rows, extracting signals which are 
10 representative of an intensity of photo-exposure of light-sensitive elements 

associated with a first spectral region; and 

from each row in the second set of rows, extracting signals which are 
representative of an intensity of photo-exposure of light-sensitive elements 
associated with a second spectral region which is distinct from the first spectral 
1 5 region; and 

at a second scanning circuit, 

from each row in the first set of rows, extracting signals which are 
representative of an intensity of photo-exposure of light-sensitive elements 
associated with a third spectral region which is distinct from the first and second 
20 spectral regions; and 

from each row in the second set of rows, extracting signals which are 
representative of an intensity of photo-exposure of light-sensitive elements 
associated with a spectral region which is distinct from the first and second 
spectral regions, 

25 wherein the signals representative of the intensity photo-exposure of each light-sensitive 

element associated with the first and second spectral regions is extracted at the first scanning 
circuit and the signals representative of the intensity of photo-exposure of each light-sensitive 
element associated with the third spectra! region is extracted at the second extraction circuit. 

2. The method of claim 1, the method further comprising at the second scanning circuit, 
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extracting signals from each row in the second set of rows which are representative of an 
intensity of photo-exposure of light-sensitive elements associated with the third spectral region. 
3. The method of claim 2, the method further including: 

at the first scanning circuit, extracting signals which are representative of an 
5 intensity of photo-exposure of light-sensitive elements associated with red and blue 

Spectra! regions; and 

at the second scanning circuit, extracting signals which are representative of an 
intensity of photo-exposure of light-sensitive elements associated with a green spectral 
region. 

10 4. The method of claim 1, the method further comprising, at the second scanning circuit, 
extracting signals from each row in the second set of rows which are representative of an 
intensity of photo-exposure of light-sensitive elements associated with a fourth spectral region 
which is distinct from the first, second and third spectral regions. 

5. The method of claim 4, wherein the method further includes: 

1 5 at the first scanning circuit, extracting signals which are representative of an 

intensity of photo-exposure of light-sensitive elements associated with red and blue 

spectral regions; and 

at the second scanning circuit, extracting signals which are representative of an 
intensity of photo-exposure of light-sensitive elements associated with green and white 

20 spectral regions. 

6. A method of extracting data representative of photo-exposure intensity values from 
light-sensitive elements in an array of light-sensitive elements, the array having distinct first and 
second sets of rows of the light sensitive elements, each of the light-sensitive elements having a 
sensitivity to energy in one of a plurality of spectral regions and being associated with a 

25 corresponding spectral region, the extraction process occurring.in first extraction intervals in 

which data is extracted from rows in the first set of rows and second extraction intervals in which 
data is extracted from rows in the second set of rows, the method comprising: 

at a first scanning circuit, extracting signals representative of an intensity of 
photo-exposure of each light-sensitive element associated with a first spectral region 
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during the first extraction intervals and extracting signals representative of an intensity 
of photo-exposure of each light-sensitive element associated with a second spectral 
region, at the second extraction intervals; and 

at a second scanning circuit, extracting signals representative of an intensity of 
5 photo-exposure of each light-sensitive element associated with a third spectral region, at 

the first extraction intervals, the third spectral region being distinct from the first and 
second spectral regions, and extracting signals representative of an intensity of photo- 
exposure of each light-sensitive element associated with a spectral region distinct from 
the first and second spectral regions at the second extraction intervals. 
10 7. The method of claim 6, the method further comprising: 

following each of the first extraction intervals, reading out data from the first 
scanning circuit which is representative of the intensity of photo-exposure of light 
sensitive elements associated with the first spectral region, and reading out data from the 
second scanning circuit which is representative of the intensity of photo-exposure of 
1 5 light sensitive elements associated with the third spectral region; and 

following each of the second extraction intervals, reading out data from the first 
scanning circuit which is representative of the intensity of photo-exposure of light 
sensitive elements associated with the second spectral region, and reading out data from 
• the second scanning circuit which is representative of the intensity of photo-exposure of 
20 light sensitive elements associated with the third spectral region. 

8. A system for extracting data from an array of light-sensitive elements, each of the light- 
sensitive elements having a sensitivity to energy in a corresponding one of a plurality of spectral 
regions and being associated with the corresponding spectral region, the system comprising: 
25 a first scanning circuit for extracting signals representative of an intensity of 

photo-exposure of light sensitive elements associated with a first spectral region at a first 
set of extraction intervals, and extracting signals representative of an intensity of photo- 
exposure of light sensitive elements associated with a second spectral region at a second 
set of extraction intervals time multiplexed with the first set of extraction intervals, the 
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second spectral region being distinct from the first spectral region; and 

a second scanning circuit for extracting signals representative of an intensity of 
photo-exposure of light sensitive elements associated with a third spectral region at the 
first set of extraction intervals, the third spectral region being distinct from the first and 
5 second spectral regions, and extracting signals representative of an intensity of photo- 

exposure of light sensitive elements associated with a spectral region which is distinct 
from the first and second spectral regions at the second set of extraction intervals. 
9. A method of extracting data representative of photo-exposure intensity values from 
light-sensitive elements in an array of light-sensitive elements, the array having rows of the light 
10 sensitive elements, each of the light-sensitive elements having a sensitivity to energy in one of a 
plurality of spectral regions and being associated with a corresponding spectral region, each 
row having light-sensitive elements associated with at least two spectral regions, the method 
comprising: 

selecting a row in the array for extracting signals representative of the intensities 
1 5 of photo-exposure of light-sensitive elements in the selected row; and 

extracting the signals representative of the intensities at a plurality of scanning 
circuits, wherein all signals representative of the intensities extracted at any one 
scanning circuit are associated with exactly one spectral region. 

20 10. In a camera for focusing light from an object onto an array of light sensitive-elements, 
each of the light-sensitive elements having a sensitivity to energy in a corresponding one of a 
plurality of spectral regions and being associated with the corresponding spectral region, the 

improvement including: 

an extraction circuit for extracting data representative of an intensity of photo- 
25 exposure of each of a plurality of the light-sensitive elements at extraction intervals, the 

data extracted at each extraction interval originating from light-sensitive elements 
associated with a common spectral region; and 

a gain circuit for applying a uniform gain to the data extracted at each extraction 
interval based upon the common spectral region associated with the light-sensitive 
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elements from which the data originated. 
1 1 . The camera of claim 1 0, the digital camera further including: 

a first extraction circuit for extracting data representative of an intensity of 
photo-exposure of each of a plurality of the light-sensitive elements at the extraction 
5 intervals, the data extracted at any particular extraction interval originating from light- 

sensitive elements associated with a single spectral region which is one of a first and a 
second spectral region, the first and second spectral regions being distinct from one 
another; and 

a second extraction circuit for extracting data representative of an intensity of 
10 photo-exposure of each of a plurality of the light-sensitive elements at the extraction 

intervals, the data extracted at each extraction interval originating from light-sensitive 
elements associated with a third spectral region, the third spectral region being distinct 
from the first and second spectral regions, 

wherein the gain circuit applies a first uniform gain to extracted data 
15 representative of the intensity of photo-exposure of the light-sensitive elements 

associated with the first spectral region, a second uniform gain to extracted data 
representative of the intensity of photo-exposure of the light-sensitive elements 
associated with the second spectral region, and a third uniform gain to extracted data 
representative of the intensity of photo-exposure of the light-sensitive elements 
20 associated with the third spectral region. 

12. The camera of claim 10, wherein the second extraction circuit extracts data 
representative of an intensity of photo-exposure of each of a plurality of the light-sensitive 
elements at the extraction intervals, the data extracted at any particular extraction interval 
originating from light-sensitive elements associated with a single spectral region which is either 

25 the third or a fourth spectral region, the fourth spectral region being distinct from the first, 
second and third spectral regions, and wherein the gain circuit applies a uniform gain to 
extracted data representative of the intensity of photo-exposure of the light-sensitive elements 
associated with the fourth spectral region. 

13. A method of processing data from an array of light-sensitive elements which is 
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representative of intensity of photo-exposure of light-sensitive elements, each of the light- 
sensitive elements having a sensitivity to energy in a corresponding one of a plurality of spectral 
regions and being associated with the corresponding spectral region, the method comprising: 
extracting data representative of an intensity of photo-exposure of each of a 
5 plurality of the light-sensitive elements at extraction intervals, the data extracted at each 

extraction interval originating from light-sensitive elements associated with a common 
spectral region; and 

applying a uniform gain to the data extracted at each extraction interval based 
upon the common spectral region associated with the light-sensitive elements from 
10 which the data originated. 

14. The method of claim 12, the method further including: 

at a first extraction circuit, extracting data representative of an intensity of 
photo-exposure of each of a plurality of the light-sensitive elements at the extraction 
intervals, the data extracted at any particular extraction interval originating from light- 
1 5 sensitive elements associated with a single spectral region which is either a first or a 

second spectral region, the first and second spectral regions being distinct from one 
another; 

at a second extraction circuit, extracting data representative of an intensity of 
photo-exposure of each of a plurality of the light-sensitive elements at the extraction 
20 intervals, the data extracted at each extraction interval originating from light-sensitive 

elements associated with a third spectral region, the third spectral region being distinct 
from the first and second spectral regions; and 

applying a first uniform gain to extracted data representative of the intensity of 
photo-exposure of the light-sensitive elements associated with the first spectral region, a 
25 second uniform gain to extracted data representative of the intensity of photo-exposure 

of the light-sensitive elements associated with the second spectral region, and a third 
uniform gain to extracted data representative of the intensity of photo-exposure of the 
light-sensitive elements associated with the third spectral region. 
15. The method of claim 13, the method further including: 
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at the second extraction circuit, extracting data representative of an intensity of 
photo-exposure of each of a plurality of the light-sensitive elements at the extraction 
intervals, the data extracted at any particular extraction interval originating from light- 
sensitive elements associated with a single spectral region which is one of the third and 
5 a fourth spectral region, the fourth spectral region being distinct from the first, second 

arid third spectral regions; and 

applying a uniform gain to extracted data representative of the intensity of 
photo-exposure of the light-sensitive elements associated with the fourth spectral region. 
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